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DETAILED ACTION 

1 . This Office Action is in response to the Applicants' amendment received on 
09/14/2009. 

Claim Status 

2. Claims 1-4 and 6-37 are currently presenting for examination, with claims 1, 21 
and 37 being independent. Claim 5 is canceled. 

Double Patenting 

3. Claim 1 is amended. Therefore, the nonstatutory double patenting rejection is 
withdrawn. 

Claim Objections 

4. Applicant's amendment to objection of claim 7 is acknowledged. Therefore, 
objection to the claim is withdrawn. 

Claim Rejections - 35 USC §101 

5. Applicant's amendment to rejections of claim 37 under 35 U.S.C 1 01 is 
acknowledged. Therefore, objection to claim 37 is withdrawn. 

6. Applicant's argument to rejections of claims 21-36 under 35 U.S.C 1 01 is 
acknowledged. Therefore, objection to the claims is withdrawn. 

7. This action has been made FINAL. 



Application/Control Number: 10/580,776 Page 3 

Art Unit: 2169 

Specification 

8. The disclosure is objected to because of the following informalities: the term 
"computer readable storage medium", in line 1 of claim 37 is not defined in the 
specification. Appropriate correction is required. 

Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1 0. Claims 1 -37 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Shimura, Patent Number 7,374,077, and further in view of Smirniotopoulos et al, Patent 
Number US 7,080,098 (hereinafter referred to as "Smirniotopoulos"). 

Regarding claim 1, Shimura discloses a method for retrieving medical images 
from various sources and in different formats, to enable the creation of teaching files 
and research datasets, for the building of a personal medical image library (see 
abstract), the method comprising: 
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(a) directly retrieving a plurality of medical images from various sources (e.g. the 
image input receives input from a plurality of client terminals (as sources) connected to 
the image input means by way of a network, col. 2, lines 49-52); 

(b) storing the plurality of medical images in a database (e.g. image database 
which stores a number of pieces of image data representing a number of images, col. 1 , 
line 67 through col. 2, lines 1-2); 

(c) generating a database record for the teaching files and research datasets 
(e.g. case database 20 in Figure 1 , comprises an image database 20a which stores a 
number of pieces of image data representing a number of images and a diagnostic 
database 20b which stores pieces of diagnostic data related to the pieces of image data 
stored in the image database 20a, col. 5, lines 33-37); 

(d) generating the teaching files and research datasets file (e.g. to arrange the 
image database (as research data file) to store a number of pieces of image data 
together with position information representing the position of the object of the image 
represented by the image data, col. 3, lines 16-19; and the "feature value" is an index 
on the basis of the degree of malignancy of a detected abnormal shadow, col. 2, lines 
31-33); 

(e) saving the teaching files and research datasets into the database (col. 5, lines 
33-37); and 

(f) generating at least one index of the teaching files and research datasets (e.g. 
the "feature value" is an index on the basis of the degree of malignancy of a detected 
abnormal shadow, col. 2, lines 31-33). 
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Shimura does not explicitly disclose the following: 

(g) automatically anonymizing patient identification data when the at least one 
medical image is retrieved from the various sources, wherein the patient identification 
data comprises patient sensitive information that is not revealed publicly. 

Smirniotopoulos teaches: automatically anonymizing patient identification data 
when the at least one medical image is retrieved from the various sources (e.g. multiple 
levels of security and access control schemes may be used where more sensitive 
information is being stored. Thus, multiple levels of privileges may be supported, such 
as for an author of a file, a reviewer, an editor, a guest, and system administrator. The 
level of privileges may also vary based upon the state of the file and the particular 
information being manipulated. When using multi-level access control, user could be 
restricted to visitor status with respect to portions of the file. The system may be 
designed to mask or options within a given process for which a user does not have 
sufficient privileges, col. 3, lines 37-67 through col. 4, lines 1-7), wherein the patient 
identification data comprises patient sensitive information that is not revealed publicly 
(e.g. even though a person acted as both author and editor of a given file, it is possible 
that after approval he could be restricted to visitor status with respect to certain file 
access, and may lack even these privileges with respect to portions of the file, such as 
sensitive patient information, col. 3, lines 55-61). Therefore, it would have been obvious 
to one of ordinary skill in the art at the time the invention was made to modify the similar 
image search system disclosed by Shimura to include a medical image storage and 
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retrieval system as shown by Smirniotopoulos in order to be balanced against the 
complexity of administering multilevel access (Smirniotopoulos: col. 3, lines 61-63). 

Regarding claim 2, Shimura discloses the method further including a searching 
mechanism for searching the teaching files and research datasets (e.g. searching 
means 30 which searches the case database and judges image data, col. 5, lines 22-23 
and lines 27-28) 

Regarding claim 3, Shimura further discloses, the medical images are from at 
least one discipline selected from the group consisting of radiology, nuclear medicine, 
dermatology, pathology, ophthalmology, cardiology, neurology, endoscopy, 
angiography, biomedicine, ECG, EEG, and EMG (col. 5, lines 60-67 through col. 6, lines 
1-2). 

Regarding claim 4, Shimura further discloses, the method is in accordance with 
MIRC schema (e.g. image search system, Figure 1). 

Shimura does not disclose anonymizing patient sensitive information regarding 
claims 5-15. 

Smirniotopoulos teaches: 

The patient identification data is able to be revealed to a generator of the 
teaching files and research datasets (e.g. the system may be designed to mask the 
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processes or options within a given process, for which a user does not have sufficient 
privileges, col. 4, lines 5-7). 

the automatic anonymizing of patient identification data process includes 
replacing of each item of the sensitive information with an anonymization code (col. 4, 
lines 41-57). 

the anonymization code includes a prefix, a randomly generated number and a 
type (col. 4, lines 5-7). 

the prefix is a short string of characters representing the generator of the 
sensitive information; and the type represents nature of the sensitive information (e.g. 
Figure 7 illustrates an alternative implementation in which conditional information like 
codes and non-private patient information are displayed for rapid browsing of the 
retuned results, col. 8, lines 66-67 through col. 9, lines 1-2). 

Regarding claim 10, Smirniotopoulos further discloses, a check is first performed 
to determine if the item of sensitive information has previously been anonymized and 
the anonymization code previously generated; and, if yes, retrieving and using the 
previously generated anonymization code (col. 6, lines 53-62), 

Regarding claim 11, Smirniotopoulos further discloses, the sensitive information 
includes one or more items selected from the group consisting of: patient's name, 
patient ID, other patient's names, other patient IDs, patient's birth name, patient's 
address, patient's telephone numbers, patient's mother's birth name, region of 
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residence, country of residence, military rank, branch of service, patient comments, 
additional patient history, referring physician's name, referring physician's address , 
referring physician's telephone numbers, and all other person names (e.g. patient's file, 
col. 3, lines 59-61). 

Regarding claim 12, Smirniotopoulos further discloses, wherein, in step (c), ACR 
codes are entered as a result of system prompts (col. 4, lines 41-44). 

Regarding claim 1 3, Smirniotopoulos further discloses, the ACR codes are used 
for the at least one index of the teaching files (col. 5, lines 60-67- col. 6, lines 1-2). 

Regarding claim 14, Smirniotopoulos further discloses, indexing is by at least one 
selected from the group consisting of: title, abstract, keywords, authors, affiliations, 
contacts, patient information, radiological codes, image format, image compression 
status, image modality, anatomic location, and ACR codes (col. 6, lines 10-20). 

Regarding claim 15, Smirniotopoulos further discloses, for internal searching, 
patient sensitive information is revealed, and for external searching patient sensitive 
information is anonymized (col. 7, lines 14-20). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify the similar image search system disclosed by 
Shimura to include a medical image storage and retrieval system as shown by 
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Smirniotopoulos in order to be balanced against the complexity of administering 
multilevel access (Smirniotopoulos: col. 3, lines 61-63). 

Regarding claim 16, Shimura discloses, after each medical image is retrieved in 
step (a) it can be viewed before being stored (col. 10, lines 37-43). 

Regarding claim 17, Shimura further discloses, all medical images are kept in 
their original format once retrieved (col. 2, lines 57-59). 

Regarding claim 18, Shimura further discloses the formats include at least one 
selected from the group consisting of: AVW, HDR/IMG (Analyze format version 8.0 and 
7.5), BMP (Windows Bitmap format), DICOM (Digital Imaging and Communications in 
Medicine), GIF, JPEG, JPEG 2000, PNG, PNM, PPG, RGB, RGBA, SGI, TIFF, AVW, 
HDR/IMG (Analyze format version 8.0 and 7.5), Animated GIF, MIRA, Muti-sliced TIFF, 
MOV, AVI, MP3, RM, and Waveform for ECG, EEG, EMG (e.g. it is possible to arrange 
the image database to store a number of pieces of image data together with related 
information given thereto, col. 2, lines 57-59. It's understood that one of the formats is 
needed to store or save an image to image database). 

Regarding claims 19 and 20, Shimura does not disclose, for two-dimensional 
medical 
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images, two additional JPEG images are generated for ease of browsing using a web 
browser, and for other image formats, an additional thumbnail image may be generated. 

and the two additional JPEG images are of the same size as thumbnail images. 

Smirniotopoulos discloses: for two-dimensional medical images, two additional 
JPEG images are generated for ease of browsing using a web browser, and for other 
image formats, an additional thumbnail image may be generated (e.g. To simplify the 
user's process of inputting this information a wide variety of media formats may be 
accepted. However, the multimedia database system preferably includes appropriate 
image converters for resizing or formatting the image into one of a selected group of 
formats for consistency. It is also desirable for the system to have the capability of 
automatically generating thumbnail images at this point, making subsequent display and 
browsing more convenient for users, col. 5, lines 16-24). Smirniotopoulos further 
disclose, the two additional JPEG images are of the same size as thumbnail images 
(see Figs. 7B, 9A and 9C). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify the similar image search system disclosed by 
Shimura to include the capability of automatically generating thumbnail images as 
shown by Smirniotopoulos in order to make subsequent display and browsing more 
convenient for users. 
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Regarding claim 21 , Shimura discloses an apparatus for retrieving medical 
images from various sources and in various formats for creating at least one teaching 
file and research dataset; the apparatus comprising: 

a database for storing the at least one teaching file and research dataset in a 
generated database record (e.g. image database which stores a number of pieces of 
image data representing a number of images, col. 1 , line 67 through col. 2, lines 1 -2), 

an image retrieval interface configured to directly retrieve medical images from 
various sources and in different formats (e.g. the image input receives input from a 
plurality of client terminals (as sources) connected to the image input means by way of a 
network, col. 2, lines 49-52), 

an MIRC server configured to provide an MIRC file storage service for the 
database (e.g. image search system (server) comprises a case database which stores 
images data, col. 7, lines 52-58 ), 

a graphic user interface for operation on a user's machine to communicate with 
the MIRC server (col. 2, lines 46-54); and 

a web server to service requests from the graphic user interface (e.g. image 
search system with network means an INTRANET in the hospital, internet , a leased 
line, and the like, col. 2, lines 47-56). 

Shimura does not explicitly disclose the following: 

for a user's machine automatically anonymizing patient identification data based 
upon the at least one medical image retrieved from the various sources. 
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Smirniotopoulos teaches: automatically anonymizing patient identification data 
when the at least one medical image is retrieved from the various sources (e.g. multiple 
levels of security and access control schemes may be used where more sensitive 
information is being stored. Thus, multiple levels of privileges may be supported, such 
as for an author of a file, a reviewer, an editor, a guest, and system administrator. The 
level of privileges may also vary based upon the state of the file and the particular 
information being manipulated. When using multi-level access control, user could be 
restricted to visitor status with respect to portions of the file. The system may be 
designed to mask or options within a given process for which a user does not have 
sufficient privileges, col. 3, lines 37-67 through col. 4, lines 1-7), wherein the patient 
identification data comprises patient sensitive information that is not revealed publicly 
(e.g. even though a person acted as both author and editor of a given file, it is possible 
that after approval he could be restricted to visitor status with respect to certain file 
access, and may lack even these privileges with respect to portions of the file, such as 
sensitive patient information, col. 3, lines 55-61). Therefore, it would have been obvious 
to one of ordinary skill in the art at the time the invention was made to modify the similar 
image search system disclosed by Shimura to include a medical image storage and 
retrieval system as shown by Smirniotopoulos in order to be balanced against the 
complexity of administering multilevel access (Smirniotopoulos: col. 3, lines 61-63). 

Regarding claim 22, Smirniotopoulos further discloses, the database is a 
relational database for storage of all required information, including: database tables; 
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database indexes; database scripts (e.g. a medical image storage and retrieval system 
includes a database with relationally linked tables including a disease factoid table, an 
image and image caption table, and a patient data table, see abstract); and pointers to 
the medical images, teaching files and research datasets (Fig. 7B). Therefore, it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
to modify the similar image search system disclosed by Shimura to include relationally 
linked tables as shown by Smirniotopoulos in order for rapid browsing of the results, 
along with appropriate links to additional information. 

Regarding claim 23, Shimura discloses, wherein the server serves requests 
received from a user via the graphic user interface on a user's machine; the graphic 
user interface being for providing access functions and file editing functions (e.g. image 
search system with network means an INTRANET in the hospital, internet, a leased 
line, and the like, col. 2, lines 47-56). 

1 1 . Claims 24-28 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Shimura, Patent Number 7,374,077, and further in view of Stefanescu et al., Publication 
Number US 2003/0013951 (hereinafter referred to as "Stefanescu"). 

Regarding claims 24-29, Shimura does not disclose the following: 
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the image server includes at least one selected from the group consisting of: a 
two dimensional image loader, a three dimensional image loader, a multi-media loader 
and a telemetry loader. 

the two-dimensional image loader is for retrieving two-dimensional still images. 

the three-dimensional image loader is for retrieving three-dimensional still 
images. 

the multi-media loader is for retrieving multi-media files (§0043, line 1-3). 
the telemetry loader is for retrieving telemetry data (§0043, lines 1-3). 
and 

the graphic user interface includes a PMIL client as a user interface able to run in 
a web browser or as a stand alone application on a user's machine, and provides MRIC 
editing functions 

Stefanescu discloses: an image database containing images pre-processed for 
matching. Atlas matching may be provided, such as in the atlas workspace, in which 
images may be retrieved that match the position (in one, two, or three reference planes) 
being viewed in, or selected within, a three-dimensional object displayed within the atlas 
(§0058, lines 5-11). Wherein, image database is included in the database server 
(§0043, lines 7-8); and the image database may includes a atlas workspace of user 
interfaces as an image loader in which images may be retrieved (§0043, lines 9-10 and 
§0053). Stefanescu further discloses, the graphic user interface includes a PMIL client 
as a user interface able to run in a web browser or as a stand alone application on a 
user's machine, and provides MRIC editing functions (§0053-§0054). Therefore, it 
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would have been obvious to one of ordinary skill in the art at the time the invention was 
made to modify the similar image search system disclosed by Shimura to include a user 
interface for a medical image processing system as shown by Stefanescu to distributed 
image processing functions in any suitable manner between a client device and one or 
more servers.. 

Regarding claim 30, Shimura further discloses, wherein the server includes an 
MIRC storage for providing an MIRC file storage service for the database and for the 
user's machine (e.g. case database 20 in Figure 1). 

Regarding claim 31 , Shimura further discloses, wherein the MIRC server further 
includes an MIRC query to provide queries as defined by the MIRC scheme (e.g. a 
searching means which searches the database for similitude image data representing 
an image which is similar to an image represented by the input search image, col. 2, 
lines 6-9). 

Regarding claim 32, Shimura further discloses, wherein the at least one teaching 
file is in accordance with a Medical Imaging Resource Centre standard (col. 5, lines 55- 
59). 

Claims 33-36 are similar to claims 17-20; therefore, claims 33-36 are rejected by 
the same reasons as discussed above. 
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Claim 37 has the same functions with claim 1 . Therefore, claim 37 is rejected by 
the same reasons as discussed above. 

Response to Arguments 

12. Applicant's arguments filed 09/1 4/2009 have been fully considered but they are 
not persuasive. 

In response to Applicant's argument: Shimura does not disclose or teach 
"retrieving medical images from various sources". The Examiner respectfully disagrees. 

Shimura discloses: the image input receives input from a plurality of client 
terminals (as sources) connected to the image input means by way of a network, col. 2, 
lines 49-52. Wherein, the image input means to input an object image data together 
with position information representing a part on the basis of which similitude image data 
is to be search for while the searching means is arranged to search for a piece (a 
plurality of pieces) of similitude image data taking into account the correspondence of 
position information, col. 3, lines 16-25. The searching means may judge whether a 
piece of image data is a similitude image data or a combination of two or more of such 
judgmental items, col. 2, lines 27-30. The images in Shimura teaching are medical 
images; that medical images have been taken various medical images such as X-rays, 
computerized axial tomographies, and magnetic resonance images in various medial 
facilities, col. 1 , lines 1 0-1 6). Therefore, Shimura clearly teach the technique of 
"retrieving medical images from various sources". 
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In response to Applicant's argument: Smirniotopoulos fails to disclose 
"automatically anonymizing patient identification data when the at least one medical image is 
retrieved from the various sources, wherein the patient identification data comprises patient 
sensitive information that is not revealed publicly ". The Examiner respectfully disagrees. 

Smirniotopoulos teaches: automatically anonymizing patient identification data 
when the at least one medical image is retrieved from the various sources (e.g. multiple 
levels of security and access control schemes may be used where more sensitive 
information is being stored. Thus, multiple levels of privileges may be supported, such 
as for an author of a file, a reviewer, an editor, a guest, and system administrator. The 
level of privileges may also vary based upon the state of the file and the particular 
information being manipulated. When using multi-level access control, user could be 
restricted to visitor status with respect to portions of the file. The system may be 
designed to mask or options within a given process for which a user does not have 
sufficient privileges, col. 3, lines 37-67 through col. 4, lines 1-7), wherein the patient 
identification data comprises patient sensitive information that is not revealed publicly 
(e.g. even though a person acted as both author and editor of a given file, it is possible 
that after approval he could be restricted to visitor status with respect to certain file 
access, and may lack even these privileges with respect to portions of the file, such as 
sensitive patient information, col. 3, lines 55-61). As discussed above, in Shimura 
teaching, the image input means to input an object image data together with related 
information; wherein, the related information may be at least one of object part 
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information representing the object part, modality information representing the modality 
of taking the image, personal information (Shimura: col. 3, lines 1-6). Therefore, in 
combination Shimura in view of Smirniotopoulos clearly teach the technique of 
"automatically anonymizing patient identification data when the at least one medical image is 
retrieved from the various sources, wherein the patient identification data comprises patient 
sensitive information that is not revealed publicly ". 

Base on the amended claims 1 , 21 and 37, Examiner has cited particular 
columns and line numbers in the reference applied to claims 1 , 21 and 37 above for the 
convenience of the Applicant (see rejections above). The Examiner respectfully 
submits that the Applicants' arguments only state that the cited reference fail to teach or 
suggest limitations recited in the amended claims, but do not appear to present any 
clarity or submit that the limitations are fully supported by the originally-filed 
specification. Applicant must discuss the references applied against the claim, 
explaining how the claim avoids the references or distinguish from them. For this 
reason, Examiner has full latitude to interpret each claim in the broadest reasonable 
sense (in re Morris, 127 F.3d 1048, 105455, 44USPQ2d 1023, 1027-28 (Fed. Cir. 
1 997)). Examiner references prior art using terminology familiar to one of ordinary skill 
in the art. Such an approach is broad in concept and can be either explicit or implicit in 
meaning. Finally, this application is now considered. The rejection of the claim under 
35 USC 103(a) is maintained. 
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The 103 rejections to dependent claims are also maintained because 
independent claims are representative of claims 2-4, 6-20 and 22-36. 

Conclusion 

13. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

14. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CECILE VO whose telephone number is (571)270-3031 . 
The examiner can normally be reached on Mon - Thu (9AM - 5:00PM EST). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Tony Mahmoudi can be reached on 571-272-4078. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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